Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding

This work addresses the problem of semantic scene understanding under dense fog. Although considerable progress has been made in semantic scene understanding, it is mainly related to clear-weather scenes. Extending recognition methods to adverse weather conditions such as fog is crucial for outdoor applications. In this paper, we propose a novel method, named Curriculum Model Adaptation (CMAda), which gradually adapts a semantic segmentation model from light synthetic fog to dense real fog in multiple steps, using both synthetic and real foggy data. In addition, we present three other main stand-alone contributions: 1) a novel method to add synthetic fog to real, clear-weather scenes using semantic input; 2) a new fog density estimator; 3) the Foggy Zurich dataset comprising $3808$ real foggy images, with pixel-level semantic annotations for $16$ images with dense fog. Our experiments show that 1) our fog simulation slightly outperforms a state-of-the-art competing simulation with respect to the task of semantic foggy scene understanding (SFSU); 2) CMAda improves the performance of state-of-the-art models for SFSU significantly by leveraging unlabeled real foggy data. The datasets and code are publicly available.Comment: final version, ECCV 201

Enhancement of Retinal Fundus Images via Pixel Color Amplification

We propose a pixel color amplification theory and family of enhancement methods to facilitate segmentation tasks on retinal images. Our novel re-interpretation of the image distortion model underlying dehazing theory shows how three existing priors commonly used by the dehazing community and a novel fourth prior are related. We utilize the theory to develop a family of enhancement methods for retinal images, including novel methods for whole image brightening and darkening. We show a novel derivation of the Unsharp Masking algorithm. We evaluate the enhancement methods as a pre-processing step to a challenging multi-task segmentation problem and show large increases in performance on all tasks, with Dice score increases over a no-enhancement baseline by as much as 0.491. We provide evidence that our enhancement preprocessing is useful for unbalanced and difficult data. We show that the enhancements can perform class balancing by composing them together.Comment: Accepted to International Conference on Image Analysis and Recognition, ICIAR 2020 ; // Published at https://doi.org/10.1007/978-3-030-50516-5_26 ;// CODE, SLIDES, and an expanded/modified 20 page version https://github.com/adgaudio/ietk-re

Learned Pre-Processing for Automatic Diabetic Retinopathy Detection on Eye Fundus Images

Diabetic Retinopathy is the leading cause of blindness in the working-age population of the world. The main aim of this paper is to improve the accuracy of Diabetic Retinopathy detection by implementing a shadow removal and color correction step as a preprocessing stage from eye fundus images. For this, we rely on recent findings indicating that application of image dehazing on the inverted intensity domain amounts to illumination compensation. Inspired by this work, we propose a Shadow Removal Layer that allows us to learn the pre-processing function for a particular task. We show that learning the pre-processing function improves the performance of the network on the Diabetic Retinopathy detection task.Comment: Accepted to International Conference on Image Analysis and Recognition ICIAR 2019 Published at https://doi.org/10.1007/978-3-030-27272-2_3

Valorizing the 'Irulas' traditional knowledge of medicinal plants in the Kodiakkarai Reserve Forest, India

A mounting body of critical research is raising the credibility of Traditional Knowledge (TK) in scientific studies. These studies have gained credibility because their claims are supported by methods that are repeatable and provide data for quantitative analyses that can be used to assess confidence in the results. The theoretical importance of our study is to test consensus (reliability/replicable) of TK within one ancient culture; the Irulas of the Kodiakkarai Reserve Forest (KRF), India. We calculated relative frequency (RF) and consensus factor (Fic) of TK from 120 Irulas informants knowledgeable of medicinal plants. Our research indicates a high consensus of the Irulas TK concerning medicinal plants. The Irulas revealed a diversity of plants that have medicinal and nutritional utility in their culture and specific ethnotaxa used to treat a variety of illnesses and promote general good health in their communities. Throughout history aboriginal people have been the custodians of bio-diversity and have sustained healthy life-styles in an environmentally sustainable manner. However this knowledge has not been transferred to modern society. We suggest this may be due to the asymmetry between scientific and TK, which demands a new approach that considers the assemblage of TK and scientific knowledge. A greater understanding of TK is beginning to emerge based on our research with both the Irulas and Malasars; they believe that a healthy lifestyle is founded on a healthy environment. These aboriginal groups chose to share this knowledge with society-at-large in order to promote a global lifestyle of health and environmental sustainability

Reversible Integration of Microfluidic Devices with Microelectrode Arrays for Neurobiological Applications

The majority of current state-of-the-art microfluidic devices are fabricated via replica molding of the fluidic channels into PDMS elastomer and then permanently bonding it to a Pyrex surface using plasma oxidation. This method presents a number of problems associated with the bond strengths, versatility, applicability to alternative substrates, and practicality. Thus, the aim of this study was to investigate a more practical method of integrating microfluidics which is superior in terms of bond strengths, reversible, and applicable to a larger variety of substrates, including microfabricated devices. To achieve the above aims, a modular microfluidic system, capable of reversible microfluidic device integration, simultaneous surface patterning and multichannel fluidic perfusion, was built. To demonstrate the system’s potential, the ability to control the distribution of A549 cells inside a microfluidic channel was tested. Then, the system was integrated with a chemically patterned microelectrode array, and used it to culture primary, rat embryo spinal cord neurons in a dynamic fluidic environment. The results of this study showed that this system has the potential to be a cost effective and importantly, a practical means of integrating microfluidics. The system’s robustness and the ability to withstand extensive manual handling have the additional benefit of reducing the workload. It also has the potential to be easily integrated with alternative substrates such as stainless steel or gold without extensive chemical modifications. The results of this study are of significant relevance to research involving neurobiological applications, where primary cell cultures on microelectrode arrays require this type of flexible integrated solution

PDP-1 Links the TGF-β and IIS Pathways to Regulate Longevity, Development, and Metabolism

The insulin/IGF-1 signaling (IIS) pathway is a conserved regulator of longevity, development, and metabolism. In Caenorhabditis elegans IIS involves activation of DAF-2 (insulin/IGF-1 receptor tyrosine kinase), AGE-1 (PI 3-kinase), and additional downstream serine/threonine kinases that ultimately phosphorylate and negatively regulate the single FOXO transcription factor homolog DAF-16. Phosphatases help to maintain cellular signaling homeostasis by counterbalancing kinase activity. However, few phosphatases have been identified that negatively regulate the IIS pathway. Here we identify and characterize pdp-1 as a novel negative modulator of the IIS pathway. We show that PDP-1 regulates multiple outputs of IIS such as longevity, fat storage, and dauer diapause. In addition, PDP-1 promotes DAF-16 nuclear localization and transcriptional activity. Interestingly, genetic epistasis analyses place PDP-1 in the DAF-7/TGF-β signaling pathway, at the level of the R-SMAD proteins DAF-14 and DAF-8. Further investigation into how a component of TGF-β signaling affects multiple outputs of IIS/DAF-16, revealed extensive crosstalk between these two well-conserved signaling pathways. We find that PDP-1 modulates the expression of several insulin genes that are likely to feed into the IIS pathway to regulate DAF-16 activity. Importantly, dysregulation of IIS and TGF-β signaling has been implicated in diseases such as Type 2 Diabetes, obesity, and cancer. Our results may provide a new perspective in understanding of the regulation of these pathways under normal conditions and in the context of disease

HIV-1 Infection of DC: Evidence for the Acquisition of Virus Particles from Infected T Cells by Antigen Uptake Mechanism

Dendritic cells (DC) play a pivotal role in transmission and dissemination of HIV-1. Earlier studies reported that DC present at the site of infection trap virus particles via DC-SIGN and transfer the virus to the interacting naïve T cells. This prompted us to ask the question whether DC could acquire virus from infected T cells during DC-T cell interaction. To address this, we investigated the likely transfer of virus from HIV-1 infected T cells to DC and the underlying mechanisms involved. Results indicate that DC acquire virus from infected T cells via antigen uptake mechanism and this results in infection of DC with expression of proteins directed by viral DNA. Further studies with HIV-1 lacking the Env protein also resulted in infection of DC. The use of antibodies against DC-SIGN and DC-SIGN-R ruled out a role for receptor in the infection of DC. Additional data show that DC infection is directly correlated with the ability of DC to take up antigen from infected T cells. Overall, these studies provide evidence to suggest that HIV-1, besides infecting immune cells, also utilizes immunological mechanism(s) to acquire and disseminate virus